SIGNFORMER: DeepVision Transformer for Sign Language Recognition

نویسندگان

چکیده

Sign language is the most common form of communication for hearing impaired. To bridge gap with such impaired people, a normal people should be able to recognize signs. Therefore, it necessary introduce sign recognition system assist people. This paper proposes Transformer Encoder as useful tool recognition. For static Indian signs, authors have implemented vision transformer. language, proposed methodology archives noticeable performance over other state-of-the-art convolution architecture. The suggested divides into series positional embedding patches, which are then sent transformer block four self-attention layers and multilayer perceptron network. Experimental results show satisfactory identification gestures under various augmentation methods. Moreover, approach only requires very small number training epochs achieve 99.29 percent accuracy.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sign language perception research for improving automatic sign language recognition

Current automatic sign language recognition (ASLR) seldom uses perceptual knowledge about the recognition of sign language. Using such knowledge can improve ASLR because it can give an indication which elements or phases of a sign are important for its meaning. Also, the current generation of data-driven ASLR methods has shortcomings which may not be solvable without the use of knowledge on hum...

متن کامل

MAN-MACHINE INTERACTION SYSTEM FOR SUBJECT INDEPENDENT SIGN LANGUAGE RECOGNITION USING FUZZY HIDDEN MARKOV MODEL

Sign language recognition has spawned more and more interest in human–computer interaction society. The major challenge that SLR recognition faces now is developing methods that will scale well with increasing vocabulary size with a limited set of training data for the signer independent application. The automatic SLR based on hidden Markov models (HMMs) is very sensitive to gesture's shape inf...

متن کامل

Sign Language Recognition

This chapter covers the key aspects of Sign Language Recognition (SLR), starting with a brief introduction to the motivations and requirements, followed by a précis of sign linguistics and their impact on the field. The types of data available and the relative merits are explored allowing examination of the features which can be extracted. Classifying the manual aspects of sign (similar to gest...

متن کامل

Visual Sign Language Recognition

We have developed the Hand Motion Understanding (HMU) system that understands static and dynamic signs of the Australian Sign Language (Auslan). The HMU system uses a visual 3D hand tracker for motion sensing, and an adaptive fuzzy expert system for classification of the signs. This paper presents the hand tracker that extracts 3D hand configuration data with 21 degrees-of-freedom (DOFs) from a...

متن کامل

Sign Language Recognition

Our goal here is to recognize a sign language measured from wearable sensor gloves. A sign language is expressed as a sequence of gestural patterns to convey a meaning. Hidden Markov models (HMMs) have been shown to be successful in temporal pattern recognition, such as speech, handwriting, and gesture recognition [4]. In this project, we investigate how well HMMs can perform when applied to si...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2022.3231130